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ABSTRACT 



Five models are introduced for the factor analytic treatment of a 
set of measures obtained for the same sample of persons on two different 
occasions. The models differ in terms of the assumptions made regarding the 
constancy of the (1) factor (actually component) score and (2) factor pattern 
matrices from occasion 1 to 2- Least-squares procedures are developed for 
the estimation of the component scores and patterns under four of the models; 
canonical correlation procedures are developed for the fifth* Illustrative 
examples using these procedures are presented, and the research implications 
of the hypotheses and procedures underlying each model are discussed. 
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SOME NOTES ON THE FACTOR ANALYTIC TREATMENT 
OF MEASURES OBTAINED ON TWO DIFFERENT OCCASIONS 

A. Ralph Hakstian 
University of Alberta 



The purpose of this paper is not to develop a single, in some sense 
preferred, procedure for the factor analysis of data matrices obtained on 
two occasions, but rather to bring into clearer focus the parameters of 
such a situation and to suggest possible analysis strategies depending upon 
the assumptions the experimenter wishes to make about his data and the particular 
questions he wishes to answer. In a strict sense, what is to follow is only 
generically "factor analysis," as the estimation of eommunality implied by 
the common^ factor model is absent* Instead, considerable use is made of the 
Eckart-Young theorem (see Eckart & Young, 1936; Johnson, 1963), and the 
component model is generally implied. We begin with a discussion of some 
important characteristics and assumptions associated with longitudinal data. 
Following this, certain of the possible alternatives are selected and developed 
into clearly operational analysis strategies. Empirical examples of some of 
these strategies follow, and we conclude with a word concerning practical 
implications , 

JL . Parameters of Longitudinal Dat a 

One way to analyze longitudinal data is to treat occasion either as the 
observational unit—on which scores on either variables or persons are 
recorded— or as the attribute being measured, in conjunction with either a 
single variable or a single person. Two dimensional designs involving 
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occasions by persons or variables constitute four of Cattail’s [1952] six 
factor analytic designs— 0-, P-, 5~, and ^techniques , For these designs to 
lend stability to the obtained correlations and factors, however, a large 
number of occasions is generally required, analogously to the requirement 
of a reasonably sizeable person sample in standard, or R- technique, factor 
analysis * 

The experimenter may not wish to obtain factors either representing 
occasion groupings or based on Intar^oceasion variation, but, instead may 
require standard factors — representing variable groupings and based on inter- 
person variation — that are-, in some sense, stable or present over two or more 
occasions. Given the latter requirement, several alternatives exist. His- 
torically, longitudinal studies involving the same battery of tests administered 
to the same sample of persons on two or more occasions have reflected the 
assumption of unchanging factor scores, with the changing factor pattern 
matrices the locus of interest [.e • j|.- > Evans, 1967; Fleishman, 1957, 1960, 

1966; Harris, 1963; Meyer & Bendig, 1961], Tucker’s [1963] application of 
three-mode factor analysis to the measurement of change reflected the converse 
assumption, that of unchanging pattern coefficients but changing factor scores* 
The procedures derived by Corballis and Traub [1970] are based on both changing 
factor scores and changing factor patterns, and an excellent discussion of 
the conceptual merits of the differing assumptions can be found in this 
latter paper. 

A feature of the model proposed by Corballis and Traub [1970] is that 
although factor scores may change, from occasion 1 to 2, these factor scores 
are orthogonal both within and between occasions. It is the opinion of the 
present author that although the restriction to wi thin-oceas ion factor 
orthogonality may not be excessive, that to between-occasion orthogonality 
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is unwarranted. The effect of this latter constraint is to specify uniquely 
the factor pattern matrices for the two occasions, thus precluding a simple 
structure rotation if the initially obtained factor patterns are difficult 
to interpret . 

The purpose of the remainder of the present paper, then, is the 
presentation of procedures for analyzing longitudinal data under several of the 
assumptions, in turn, mentioned earlier. We are interested, exclusively , 
in the experimental situation in which the same sample of persons is measured 
on the same set of variables on two different occasions. We thus are 
concerned with the prates t-pos ttest or change paradigm so useful in psychological 
and educational research, where the aim may be to isolate time-stable constructs, 
to study correlates of the constructs at the two different times, to note 
changes over time in constructs of interest, or perhaps, to observe the 
effects on these constructs of intervening experimental treatments# 

_2 . Derivation of Analysis Procedures 

In this section, our aim is to consider, in turn, various experimental 
situations which differ in the assumptions made about the constancy of the 
factor score and factor pattern matrices over the two occasions. As has 
been mentioned, the common-factor model is not implied as it was in the 
paper by Corballis and Traub [1970]; that is to say we are not concerned 
with the estimation of communal! ties as well as common-factor loadings. 

Instead, the component model is implied, and extensive use is made of the 
E ck ar t - Y o un g theorem and its implications (see Eckart & Young, 1936; Johnson, 
1963). In most cases, however, although the component model is implied, the 
task is to find a least— squares fit to either two sets of components or two 
matrices of pattern coefficients, or perhaps both. 

In the various situations for which procedures are derived, we begin with 
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two data matrices , and Z ^ , both of order N_ persons x n variables — the 
latter of which are standardized to have zero mean and unit variance”’”* re. pre- 
senting , respectively s occasions 1 and 2. The particular _N persons and n 
variables are, of course, common to both occasions. Standard scores on new, 
derived components are contained In the matrices X^ and — if scores are 
separately derived for each occasion“-or — if a matrix common to both occasions 
is hypothesized. These matrices are EJ x t_ 9 where r < n components are con- 
sidered adequate. We return to the issue of determing _r later in the paper, 
but will assume r^ is known in the procedures that follow. The component 
pattern matrices, relating the X's to the Z/s, are designated and JC, or 
simply _F, if a common pattern is hypothesized; all are n. x ir. In all cases, 
the matrices may be transformed to a simple structure pattern, P , n x r , 
by a transformation matrix JT, _r x jr, either orthonormal or in some cases, oblique 
Given the two data matrices, and Z~ 9 a standard principal-components 
analysis of each is embodied in the following weil*known equations* 



( 1 ) 



Z ± = X 1 F^ + E 1 XjTjPJ + E v and 



X 2 F 2 + E 2 * X 2 T 2 P 2 + V 



where and E^, both N x n, are matrices of "errors” of fit of the XF f or XTP y 
matrices to the Z T s „ Given _Fj or of rank _r < ri , then by the Eekart* 

Young [1936] theorem, tr[E^jEj] is minimal. In the specific instances that 
follow 5 , ( 1 ) is modified according to the specific hypothesis made. 

Case I 



We begin with the most restrictive situation, that in which, for 
descriptive and conceptual reasons, we seek a single component pattern matrix 
that relates a single matrix of component scores, in a least— squares sense, 
to the two observed data matrices, and _Z ^ . Alternatively, we hypothesize 
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a single set of occasion-stable components which are related by a single 
pattern matrix— again hypothesized to be constant over occasions — to the 
observed data matrices. The Case I models in place of (1), is 



( 2 ) 



Z 1 ^ XF' + E 1# and 
Z 2 - XF f 4- E 2 . 



Our criterion is 

(3) ■ tr[E^E^] + trtE^E^] = minimum, 

subject to the constraints 

(4) X'X/N - X. 

Combining (3) and (4) yields 

(5) <f>* * tr[Z*Z 1 + Z^Z 2 -2FX , Z 1 -2FX f Z 2 + 2FX f XF f ] + tr[A(X f X/N -I)], 

where A , r x r s is a matrix of Lagrange multipliers. Differentiating (see 
Schdnemann, 1985) with respect to the matrices of interest, and setting the 
matrix of partial derivatives , in each case, to the null matrix yields 

(6) 3<f>*/3F = -2ZjX “2Z^X + 4FX'X - 0, and 

(7) 3**/3X = -2Z ± F -2Z 2 F + 4XF'F + (1/N)X(A + A') » 0, 



Combining (4) and (6) yields 

F - (1/2N) (ZjX + Z 2 X) , or 

(8) F = (1/ 2N)Z* 1 X, 

where Z_*, x _n, is given by + Z^. Substituting (8) in (7), we have 

(9) (1/N)Z 1 Z^ , X 4- (1/N)Z 2 Z* , X - (l/N 2 )XX f Z*Z* 1 X = XQ , 

where the symmetric matrix (£ = (A 4* Ad ) /N_. Combining the first two terms of 

(9) and premultiplying by (l/N)X f , we have 

(10) (1/N 2 )X'Z*Z*'X - (1/N 2 )X , Z*Z* , X = Q = 0, 

so chat (9) may be rewritten 
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(1/N) SX = (l/^JXX'SX, 



where - _Z‘ *Z* 1 , If we denote the canonical decomposition of S_ by 



(12) S = WL 2 W’ , 

Js 

choosing for X the matrix £1 ——where , ET x jr , is composed of the first _r 
columns of W— satisfies both (11) and (4) * The Initial pattern matrix, 



is given by (8) * 

It is unlikely, however, that the IT matrix so obtained will be of great 
interpretive value, and transformation to a simple structure will be 
generally required at this point. Thus, we seek the transformation to a 
simple structure, T, _r x r , and our new pattern I?, n x _r, and matrix of 
transformed components, X.* * N. x _r , are given by 

P = F(T')" 1 , and 



(13) 



X* = XT. 

Both Z_ and are approximated by 3C*P f , leaving the criterion, in (3) 
unaffected. If transformed components that are still orthogonal are desired, 



T^ is, of course, orthonormal and P_ = FT, 

Computationally, the process of finding the latent vectors, W, in (12) 
can be hastened by obtaining the canonical decomposition of as 

(14) Z* ; Z* - VL 2 V 5 „ 



and then obtaining W by 

(15) W - Z*VL _1 . 

Such a procedure Is considerably faster than that indicated in (12), since 
Z*'Z*, n x n, will generally be of much smaller order than will _Z * %* * , N_ x N. 



Case II 

In this case, which is somewhat less restrictive than is Case I, we 
hypothesize a constant pattern matrix over occasions, but permit the component 
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scores to change, presumably as a function of maturation, experimental treat- 
ment, or other possible causes, in much the same fashion that we would expect 
the scores on the variables themselves to change over time* The Case II mddel is 

- X^F * + E x , and 



( 16 ) 



Z 2 - X 2 F f + E 2 . 

As before, our criterion, is 

(17) = trtE^] + tr[E^E 2 ] 



minimum. 



subject to the constraints 

(IS) XjXj/N - I - X^X 2 /N. 



Combining (17) and (18) yields 

U9> 4>f z - tr[Z' 1 Z 1 + Z' 2 Z 2 -2FX|Z 1 -2FX|Z 2 + FXptp ' + FX'X.F'] 

+ tr[A 3 UjX^/N - I)] + tr[A 2 (X|X 2 /N - I)], 

where _A^ and A,* both _r x _r , are matrices of Lagrange multipliers. Differentiating 
with respect to _F, X^, and X 2 , and setting the resulting matrices of partial 
derivatives to zero, we have 

(20) a^fj/aF - ” 2Z { X 1 -2Z 2 X 2 + 2FX { X 1 + 2FX 2 X 2 = °* 

(21) -2ZjV + 2X X F*F + (1/N)X (A + Ap - 0| 

(22) 3<|.| i / 3X 2 - -2Z 2 F + 2X 2 F’F + (l/N)X 2 (A 2 + Ap = 0. 

Noting the constraints (18), we have, for (20) 

(23) F - (l/2N)(Zp 1 + Z’X 2 ), 

which, when substituted into (21) , yields 

(24) (-1/N) (ZjZp^ + Zp.pcp 4- (1/2N 2 ) (X^Xp^Zp^ + Xpppp^ 

+ X 1 Xp 1 Z^X 2 + Xp’Zppp + X X Q = 0, 

where the symmetric matrix, Q = (^ + Ap/N. Premultiplying (24) by (1/N)xp 
we have 
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(25) (1/N 2 ) (X^Z 1 Z^X 1 + X|Z 1 Z^X 2 ) - (1/2N 2 ) (XjZjZjXj. + X^Z’X^. 

+ X|Z ] Z^X 2 + X^Z 2 Z^X 2 ) - Q. 

Thus, the left side of (25) is symmetric, since Q_ is , and inspection of the 
left side of (25) reveals that for this symmetry to exist, the matrix 
2C^Z^Z^X_2 must also be symmetric. If we represent t ^ LB Eckart-Young 

factorization , 

(26) Z ± Z' 2 - WLV' , 

where we have the canonical decompositions 

= VL 2 V, and 

(27) 2 

Z^Z'Z^ = WT. W , 

h I* 

then choosing for the matrix NyW^ and for * where and _V^ contain 

the first _r columns of _W and respectively, renders 2 s Y rametr ^ c an ^ 

satisfies (18) < It should be noted that substituting (23) into (22) , rather 
than into (21), leads to exactly the same result. We then obtain _F by (23), 

We return to optimally efficient procedures for obtaining latent roots and 
vectors of the rather large (f[ x N) matrices in (27) later in the paper. 

As in the Case I situation, we may transform the obtained F_ to a simple 
structure solution, P^, in terms of either orthogonal or oblique components, 

X^- — "by the formulas in (13) - Such a transformation does not alter the minimal 
value obtained for in (17). 

Case III 

This case differs from Case II in that Instead of the component scores 
changing while being related to the observed data by a stable, unchanging 
pattern matrix, the scores are hypothesized to be constant over occasions, 
but related to the changing observed data variables by changing pattern 
matrices. Thus, instead of interest centering upon changes over time of 
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scores on variables that themselves are defined by unchanging linear composites 
of known variables, as with Case II, the locus of interest with Case III is 
the change over time in composition — in terms of the changing observed variables™ 
of the components, which themselves are hypothesized to be constant over 
occasions. As was pointed out earlier, longitudinal factor analytic studies 
have usually been based on this assumption. 



The Case 1IX model is 



(28) 



Z 1 ” XF 1 + E l- and 



- XF^ + E r 



Our criterion is 

(29) bn * tr E E i E P + tr E E 2 E 2^ = 



subject to the constraints 

(30) X'X/N = I. 

By combining (29) and (30) , we have 

(31) *ij| j - tr[Z' 1 Z 1 + Z^Z 2 - 2ZjXF^ - 2Z^XF^ + F^'XF^ + F^X'XF^] 

+ tr[A(X’X/N - I) ] , 



where, as before, A., _r x jr, is a matrix of Lagrange multipliers. Differentiating 
j£* with respect to X, F_ , and ]? , and setting the resulting matrices to the 
null matrix, we have 

(32) 8<f>* /3X - -2Z.F “ 2Z 2 F 2 + 2XF I F i + 2XF 2 F 2 + < l/N > x < A + A ') “ 0; 

(33) 3<j> III /3F l = -2Z i X + ZF^'X ■= 0; 

(34) 94>* ii /3F 2 = -2Z^X + 2F 2 X'X - 0. 

Noting the constraints, (30), we may write for (33) and (34) 

F. - ZjX/N, and 



(35) 



F 2 = ZjX/N , 




Substituting 



(35) into (32) yields 



IS 



(36) 



(2 /N) (Z^Z^ + Z 2 zpx - (2/N 2 )XX' (Z X Z^ + Z^^X = XQ , 

where the symmetric matrix _Q_ = (A + A' ) /N_* By reasoning similar to that 
employed in the Case I solution, we note that by premultiplying (36) by 
(1/N_)X T , we have 

(37) (2/N 2 ) [X' CZ ± Z[ + Z 2 ZpX] - (2/N 2 )[X’ (Z 1 Z| + Z^pX] = Q - 0, 

so that (36) and (37) together imply that 

(38) (1/N)UX - (1/N 2 )XX’UX, 

where U_ = + ^2=2* ^ wc denote the canonical decomposition of IJ as 

(39) U = VL 2 V' , 

then choosing for X the matrix N^V — where V , _N x jr, is composed of the first 
jr columns of V — satisfies both (39) and (30). We then obtain F^ and F^ by (35). 

The matter of transforming the obtained F^ and matrices to a simple 
structure is not as straightforward as with Cases I and II , since unlike 
these applications ? Case III involves two pattern matrices , but a single 
matrix of component scores. For these scores to remain identical over 
occasions after transformation they must be transformed by the same matrix, 
which implies that a single matrix, _T , must be found that results simultaneously 
in optimal simple structures for both the occasion 1 and occasion 2 pattern 
matrices. Although the problem would best be solved by optimizing a two— matrix 
analytic criterion function — for example, a simultaneous two-matrix varimax 
function — we offer the following rather simplistic alternative. Form 

(40) F* = (1/2) (F 1 + F 2 >, 

that is, average the unrotated patterns. Next, we would derive as maximizing 
the criterion function of choice when applied to F* . Then 
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where, as before, if an orthogonal transformed solution is desired, _P_, - BV1L 
It is undoubtedly clear to the reader at this point that we have assumed 
in the first three eases that a basic and enlightening structure common to both 
occasions exists — ^either in the form of component scores or pattern matrices 
relating these scores to the observed data. Needless to say, if there is 
such a substantial change from the Z ^ to the matrix that no such common 
structure exists, then attempting to fit matrices of scores or pattern 
coefficients to the two sets of data will be unsuccessful. 



Obtaining Latent Roots and Vectors for Cases IX and III 

The prospect of having to obtain the latent roots and vectors of the N x N 
matrices implied by Cases XX and III, where the number of subjects can be 
expected to be fairly large, say 100 or more, may seem, at first, prohibitive, 
in terms of computing time. Certainly, if one were to employ the well-known 
Jacobi procedure, which yields all non-zero roots and vectors simultaneously, 
the computation time involved would be prohibitive. In such instances. 
Hotelling f s [1936] procedure is much more efficient than the Jacobi method 
and certainly accurate enough. 

As a check on the speed of the Hotelling procedure, a symmetric matrix 
of order 98 x 98 was factored into latent roots and vectors, with the process 
stopped after the first _r - 5 vectors had been obtained. The CPU time on 
the University of Alberta System 360/67 computer for this problem was 
slightly over 30 seconds, a not excessive time requirement relative to that 
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Case IV 

The researcher may wish to permit both, the component scores and the 
pattern matrices to vary between occasions. The procedures developed by 
Corballis and Traub [1970] would be appropriate in such an instance — the 
model developed involving components as a special case — but the fact that no 



14 



12 



simple structure solution is generally possible must be considered a shortcoming. 
In any case, if no restrictions to equality are placed on either the component 
scores or pattern matrix, various criteria may be considered to identify an 
optimal pair of solutions. One such criterion involves obtaining true components 
for each occasion- — that is linear composites of the observed data matrices 
(unlike in Cases I, II, and III, where the observed data are only approximated 
in a least-squares sense)^^that are maximally related in a pairwise sense. 

This criterion-— clearly expressible as a canonical correlation problem — 
constitutes our Case XV, 

The Case IV model is as in (1) , which we repeat here 

Z ± - xpj + E x> and 



Cl) 



= X^F ’ + E, 



The criterion is 



(42) <J> IV = tr [XjX^/N] “ maximum, 

subject to the constraints, expressed earlier, 

(18) Xp^/N “ I =® X*X 2 /N. 

It should be clear that in (1) above, if all n components are obtained for 
both occasion 1 and occasion 2 , the _E^ and matrices will be null. 



As was noted above, X^ and are N x r linear composites of, respectively, 
and ^ 2 " see ^ c the matrices and , both n x _r , such that 



(43) 



Z 1 K 1 - X 1# and 



Z 2 K 2 = X 2 



and the conditions (42) and (18) are met. Canonical correlation analysis 
yields matrices KJ, XJ, K* , and _X^, where the respective columns of XJ and X* 
are, indeed, maximally correlated, and columns within XJ and X* are mutually 



uncorrelated, but, in general, the new variates, while certainly having zero 
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mean, do not have unit variance. Since 



( 44 ) 



Z 1 K 1 = X l’ and 



z 2 k| - X*, 



the diagonal matrices of reciprocal standard deviations of the X* and X* 
variables are obtained by 



-h 



(45) 



D x - [diag(K* , R 1 K*)] 2 , and 



D 2 =» [diag(K* ’R 2 K*) ] 



and we have, for the matrices of standardized component scores, X, and X 2 • 



( 46 ) 



X x ■ 2 1 K*D 1 , and 



X 2 Z 2 K 2 D 2' 



From (46), initial pattern matrices, F, and _F 2 , are obtained by 



( 47 ) 



F 1 = z i X ! /n 



f 2 - z’x 2 /n 



R 1 K J D 1- 



r 2 k*d 2 . 



and 



In the interests of preserving the orthogonal characteristics of the linear 
composites j and also ensuring the constancy of the value of i n (42) i 

we may seek, at this point, an orthonormal transformation matrix, jT, which 
when applied to £ and F^* renders a reasonably Interpretable simple structure. 
Since we are seeking a single transformation matrix to be applied to both 
pattern matrices, we are faced with the same situation as in Case III. Again, 
it is suggested that the F* matrix in (40) be that for which the matrix 
is established. We then have 



(48) 



= F 1 T; 


Y 1 


*= X X T 


- F 2 T; 


Y 2 


- x 2 t 



and 



so that 



(49) 

O 

ERIC 



trtYp^/N] • tr[TT’X|X 2 /N| - tr[Xp£ 2 /N] . 



16 



14 



We note that although an orthonormal t rang formation does not alter the 
value of the criterion, in (42), the individual diagonal elements of 

— 1— 2^— wil1 not * general, be the same as those of X^/N, the latter 
diagonal elements being, of course, canonical correlations between the component 
scores for occasion 1 and those for occasion 2* It is noted , finally, that 
a Case IV solution could be obtained by using the Orthogonal Procrustes 
procedures outlined in detail by Schbnemann [1966], Using such procedures, 
we would seek orthonormal transformations to be applied to the and 
matrices obtained by standard component analyses of R^ and — transformations 

that would satisfy (42) . We judge the procedure outlined in this section 
as more direct . 




Case V 



As with Case IV, with Case V we hypothesize that both the component scores 
and pattern matrices vary between occasions. With Case V, however, we attempt 
to bring both pattern matrices, rather than matrices of component scores, to 
as similar a position as possible. As with previous cases, a simple structure 
resolution is possible. 



The Case V model is, again, as in (1) 



(i) 



2 ^ — + * an< ^ 



Z 2 = X 2 F^ + K . 



Our criterion, however, is 

(50) ■ trfEj^E^] — minimum. 



where = ^ ur constraints are as in (18) , 

(18) x i x i /N = 1 “ x^x 2 /n. 

If we let - Z’^/N, and ■ :l Z ^X ^ /N , the criterion, (50), may be written 
subject to the constraints, (18), as 

(51) <f>* - (l/N 2 )tr[X^Z 1 Z^X 1 + X^Z 2 Z^X 2 -ZX’Z-jZ’X^ + trU^Xp^/N -I)] 
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where and , _r x jr, are matrices of Lagrange multipliers. Differentiating 
ji* with respect to and and setting the partial derivatives to the null 
matrix, we have 



(52) 



(53) 



3t}.*/3X 1 = (2/N 2 ) (Z 1 Z^X 1 - Z 1 Z^X 2 ) + (1/N)X ]L (A 1 + A p 



*» 0 5 and 



d<t>*/dX 2 - (2/N Z ) (Z 2 Z^X 2 - ^ 2 Z^X^) + (1/N)X 2 (A 2 + A^) - 0. 



Letting the symmetric matrix ) / 2 - (£ and premul tiplying (52) by )C ^ , 

we have, for (52), 



(54) 



xjZjZ^Xj - x { z i z i x i " N Qx- 



Equation (54), in addition to similar manipulation of (53), reveals that, by 
a symmetry argument like that used in the somewhat similar Case II, the Case V 
criterion is satisfied, subject to the constraints noted, by taking for X^ 
and X 2 » the matrices, respectively, and , where and are composed 

of the first _r columns of W and V, obtained by the Eckart-Young factorization 
given in (26), 

(26) Z ± Z^ - WLV 1 . 

The and F_ 2 matrices are subsequently given by 



(55) 



F 1 “ Zp^/N, and 



F 2 ‘ Z 2 X 2 /N ' 



At this point we would likely seek simple structure resolutions for 
F_ and j? . Xf a single orthonormal transformation, T_, is applied to F^ and F^* 
yielding £ and P , the criterion (50) is unaffected (although the individual 
diagonal elements of E.^ 2 — 12 certainl y are affected) , since if E| 2 = F^T - F^T 
- <£ - F 2 )T, then 

(56) tr[E*^E* 2 ] = tr[(E 12 T)'(E 12 T)] = tcfT’E^E^T] - trtE^E^] . 



We thus recommend that the same simplistic procedure outlined with Cases III 
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and IV solutions be used, in which we form F* = (1/2) (F^ 4- F^), and then rotate 
Ji* to a position satisfying some analytic orthogonal simple structure criterion. 
We then have, for interpretive purposes, = F^T uaa JV = ™ h ere T is 

the orthonormal transformation applied to F* , 

As with Case IV, a Case V solution could, alternatively, have bean 
obtained by applying Orthogonal Procrustes procedures [ Schonemann , 1966], 

Such procedures would be applied to and matrices obtained by standard 
component analyses of _R^ and * Again, we judge the technique outlined in 
this section to be more direct- 

The Problem of the Number of Components to Retain 

The decision regarding the appropriate value of r in the analysis 
procedures just described may be seen as either possibly the result of the 
analysis procedures themselves or the result of an assessment of the 
congruence between components derived by standard component analyses on the 
two occasions. At this time not enough experience has been gained with 
data to suggest rules of thumb for deciding the correct number of components 
when the various eases described are adopted and the analysis proceeds 
exactly as outlined. It is likely, furthermore, that different rules will 
apply in the different cases. In short, few suggestions can be made at this 
time for deciding on the appropriate number of Case II components, for example, 
as JL ^sul t of a. Case II analysis , As more experience is gained involving 
real data and the analysis procedures described, it is hoped that some suggestions 
regarding the number of components will come out of these procedures themselves. 

As is noted later, an exception to the above situation may be Case IV, 

The other alternative is to perform principal component analyses on the 
JL=l an d Z _2 nia trices , and apply current rules of thumb to ascertain r * sub- 
sequently , with a knowledge of if , the experimenter would apply the appropriate 
0 procedures as previously described. An advantage exists with longitudinal 

ERLC 
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data in deciding on r , since the notion of stability over time can be added to 
the other various rationales. As one possibility * the experimenter could 
factor R_^ and into latent roots and vectors and apply the Kaiser-Gut tman 
rule of accepting for _r> the number of latent roots greater than one. If this 
rule led to the same value of _r for the two occasions, some faith could be 
placed in this particular value* On the other hand, if the number of latent 
roots greater than one differed on the two occasions, other tests would be 
indicated . 

Cross“Correlating the components obtained on the two occasions, 5 

is another possibility that could be employed either with or without the 

aforementioned inspection of latent roots. If the canonical decompositions of 

2 2 

R_.j and are designated, respectively , , and * an ^ the matrix 

of correlations between variables on occasion 1 and 2 is designated 
then the matrix 

(57) X I X 2 /N = M i lQ i R 12 Q 2 M 2 1 

contains the cross-occasion correlations of components. If we arrange the 
rows and columns of this matrix to maximize tr » then inspection of 
the diagonal elements would Indicate at what point the components at occasion 1 
cease to have clearly identifiable pairmates at occasion 2. We might regard 
these between-occasion component correlations as component stability coefficients 
and take for _r the number of components for which the stability coefficient 
exceeds some minimal level of reliability, for example, ,7, 

Perhaps a better approach than that just described would be to determine 
the maximum congruence that can be obtained between columns of and * 

The canonical correlation procedures outlined in Case XV would provide a way 
of applying this rationale. We would simply obtain the matrices and X^ as 
given in (46), with the one difference being that we would continue to obtain 
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components until the canonical correlation dropped below some predetermined 
value, k, again, perhaps, ,7* The value of r would be the number of canonical 
correlations greater than _k . 

Summary of the Procedures Proposed 

The preceding analysis procedures are brought together in Table 1, in 
the interests of presenting a unified view of these techniques. The and 
matrices given in the column headed "Criterion” are, in general, matrices 
of discrepancies between the observed data matrices, and , and their 
reproduction from respective products of component scores and patterns. 

The "solutions" given will, for the most part, require augmentation from 
material in the text. It may be worth noting, finally, the great similarity 
between Case II and Case V. 

_3 , Empirical Examples 

In this section results of solutions based on three of the five cases 
developed earlier are presented. Each is discussed in turn, 

A Case _X Solution 

Data for the application of Case I procedures were constructed by 
computer simulation techniques. This alternative was found necessary since 
very few longitudinal studies were found in the literature, and those data 
that were available did not include the original score matrices, needed for 
a Case I solution. The results of the Case I analysis appear in Table 2, 

First, a 50 x 3 matrix was constructed using random number generation. 
Next, by rescaling of the col umn s and a roots and vectors decomposition, a 
matrix, _X, of ” true" component scores, 50 x 3, was obtained such that each 
column had exactly zero mean, unit variance, and zero intercorrelation with 
each other column, A "true" rotated pattern matrix, _P , displayed in Table 2, 
was introduced, and the product XF y formed, yielding a 50 x 9 matrix. Finally, 
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Summary of the Analysis Strategies Proposed 
under Varying Assumptions Regarding the Component Scores and Patterns 
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TABLE 2 

Correlations within and between Occasions, Correlations between True and Estimated 
Component Scores, and True and Estimated Rotated Pattern Matrices for 
a Case I Solution Using Artificial Data (Decimal Points Omitted) 



Correlations of Variables 



1 

2 

3 

4 

5 

6 

7 

8 
9 



Occasion 1 (R.^) 

100 

75 100 



78 


74 


100 












-09 


-09 


-01 


100 










-04 


-04 


-07 


67 


100 








-12 


-14 


-07 


67 


69 


100 






-11 


-01 


02 


01 


03 


-22 


100 




-07 


06 


03 


07 


05 


-16 


68 


100 


-14 


-14 


-04 


07 


08 


00 


73 


60 100 



Occasion 2 (R ) 

100 

73 100 



74 


59 


100 












-11 


-07 


11 


100 










-25 


-17 


-04 


72 


100 








-11 


-02 


13 


72 


72 


100 






10 


20 


12 


02 


-03 


14 


100 




-13 


06 


-11 


-06 


04 


11 


67 


100 


-19 


08 


-08 


-03 


-05 


14 


68 


68 
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Occasion 1 


Correlations between True 


and 






(Rows) 


and 


Occasion 


2 (Coli 


umn: 


5) (R 12 
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Estimated 


Rotated Component 


Scon 


1 


82 


78 


63 


-09 - 


-15 


-08 ■ 


-01 


-21 


“25 




Estimated Component 


2 


80 


74 


68 


-09 - 


-19 


-07 ■ 


-02 


-18 


-21 


True 






3 


73 


75 


65 


-04 - 


-17 


02 


07 


-12 


-10 


Component 


I II 


in 


4 


-09 


-02 


21 


67 


71 


80 


08 


08 


05 








5 


-03 


-06 


20 


64 


66 


62 


07 


18 


-04 


t 


967 -031 


022 


6 


-13 


-09 


06 


69 


73 


65 ■ 


-05 


-08 


-14 








7 


-02 


17 


09 


-06 - 


■07 


03 


72 


73 


71 


XI 


026 967 


-006 


8 


-04 


16 


05 


05 - 


■03 


13 


65 


65 


64 








9 


-05 


16 


03 


02 - 


■07 


08 


76 


71 


72 


III 


-021 016 


961 



Rotated Pattern Matrices 





True (P) 






Estimated 


(i) 


I 


II 


III 


I 


ii 


in 


80 


00 


00 


90 


-09 


-10 


75 


00 


00 


88 


-08 


05 


70 


00 


00 


85 


07 


01 


00 


80 


00 


00 


87 


02 


00 


70 


00 


-06 


85 


01 


00 


75 


00 


-03 


86 


-01 


00 


00 


75 


08 


-01 


88 


00 


00 


65 


-03 


03 


84 


00 


00 


70 


-08 


00 


87 
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two matrices of "errors" — and E^, both 50 x 9, of (2) were constructed using 
random numbers. These matrices were then deviated and rescaled so that each 
column had zero mean and variance ,25, The matrices XP T 4* and XP T 4 _E were 
then formed and column rescaled to have unit variance, yielding, respectively, 
and Z _2 • 

The resulting R^, , and matrices appear in Table 2# Using formulas 

(8) , ( 14)3 and { 15)3 matrices of, respectively, estimated pattern coefficients 
and component scores were obtained- A normal varimax rotation was applied 
to the obtained pattern, yielding the P matrix in Table 2- The obtained 
orthonormal transformation was then applied to the estimated component scores. 
These transformed component scores were then correlated with the "true" 
component scores constructed earlier, with the resulting correlations presented 
in Table 2, Separate component analyses of and R^ ensured that a decision 
of three components would be reached, and this value for r was retained 
throughout the analyses. 

It is probably true that the great congruence between the "true" and 
estimated elements of this example are, in large part, due to the simplicity 
and artificiality of the data, even though an attempt was made to simulate 
real conditions by generating variables with reliability only approximately 
.70 or so, as can be seen from the matrix. In any case, it appears 

true that if all that changes from occasion 1 to occasion 2 is error, and 
that time-stable variables and components can be reasonably hypothesized, the 
Case I solution is useful in delineating this stable configuration* 

A Case III Solution 

Data for the application of Case III procedures were constructed in 
somewhat the same manner as for the Case I example. It will be recalled 
that the component scores are hypothesized to be constant in Case III, with 
possibly changing patterns. The same component score matrix, X, used with 

„ 24 
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Case I was pos multiplied by the transposes of two different "true” rotated 
patterns, P_^ (identical to the P matrix of the previous example) and P^, for 
the two occasions. These patterns, as well as the other matrices of interest 
for this example, are displayed in Table 3. It will be noted that and 
differ somewhat, reflecting the fact that factorial complexity greater than 
one — for variables 3,5, and 8 — and more broadly defined factors are present 
at occasion 2, but not occasion 1, Again, two 50 x 9 matrices of random error- — 
mean zero, variance .25 by columns-^E^ and of (28), were constructed, and 

were added to XP | and XP^ , respectively. The resulting matrices were then 
column rescaled to have unit variances, yielding, respectively, _Z^ and 

Clearly, although the underlying three components (the value of three 
for _r was again confirmed from analyses of and R^) are stable over the two 
occasions , the variables themselves have changed more than randomly between 
occasions, as can be seen from the matrix. The initial pattern matrices 

were obtained using (35) , after the initial matrix of component scores had 
been computed using (39) in connection with the Hotelling procedure discussed 
earlier. The initial patterns were combined using (40) and a normal varimax 
rotation was performed on the resulting F* matrix. The transformed patterns, 
as well as transformed component scores, were obtained by (41), 

As is seen in Table 3, the three obtained vectors of component scores 
were very close to the "true" scores, and the estimated rotated pattern 
matrices for both occasion 1 and occasion 2 were extremely close to the 
corresponding "true" patterns. Once again, however, the great similarity 
between "true" and estimated elements in this example is likely, to some extent, 
a function of the artificial nature of the data. If, however, the experimenter 
wishes to hypo thesize—f or theoretical or conceptual reasons- — unchanging 
underlying components, although the variables themselves can be observed to 
change somewhat from occasion 1 to occasion 2, the Case III solution may be 
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TABLE 3 

Correlations within and between Occasions, Correlations between True and Estimated 
Component Scores, and True and Estimated Rotated Pattern Matrices for Each Occasion 
for a Case III Solution Using Artificial Data (Decimal Points Omitted) 

















Correlations 


of Variables 
















Occasion 


1 (R^ 


) 








Occasion 2 (R^ 


) 




1 


100 
















100 














2 


72 


100 














66 


100 












3 


72 


68 


100 












50 


58 


100 










4 


-06 


09 


07 


100 










-10 


-08 


42 


100 








5 


-08 


06 


02 


66 


100 








06 


13 


38 


47 


100 






6 


01 


07 


09 


70 


62 


100 






-23 


-09 


31 


69 


44 100 






7 


15 


04 


14 


01 


04 


04 


100 




14 


04 


17 


07 


46 -09 


100 




8 


08 


02 


10 


06 


06 


-08 


70 


100 


54 


52 


41 


10 


49 -08 


48 


100 


9 


06 


05 


-02 


09 


09 


01 


61 


68 100 


04 


-06 


04 


-01 


42 -18 


68 


47 100 





Correlations between 


Variables 


on Occasion 1 


Correlations between True 


and 






(Rows ) 


and 


Occasion 


2 (Columns) 


®12 


) 


Estimated 


Rotated Component 


Scores 


1 


73 


75 


43 


-14 


06 


-22 


15 


56 


03 




Estimated Component 


2 


68 


70 


58 


-06 


10 


-05 


12 


53 


00 


True 






3 


65 


75 


48 


-05 


03 


-16 


07 


46 


-02 


Component 


i ii 


in 


4 


-09 


05 


52 


66 


57 


63 


05 


08 


-11 








5 


-03 


-01 


46 


73 


54 


61 


10 


09 


09 


I 


968 -042 


069 


6 


-06 


10 


47 


77 


50 


60 


02 


04 


-02 








7 


20 


11 


12 


01 


50 


-23 


72 


54 


69 


II 


042 967 


-053 


8 


09 


09 ■ 


-01 


-12 


51 


-15 


67 


41 


61 








9 


03 


02 


09 


-08 


48 


-04 


53 


45 


67 


III 


-060 064 


960 



Rotated Pattern Matrices 



Occasion 1 O ccasi on 2 







True 




Estimated 


cpp 


True 


<*2> 


Estimated 


<z 2 > 




I 


II 


III 


i 


II 


III 


I 


II 


III 


i 


II 


III 


1 


80 


00 


00 


85 


-14 


12 


80 


00 


00 


84 


-14 


13 


2 


75 


00 


00 


83 


00 


05 


75 


00 


00 


89 


-02 


05 


3 


70 


00 


00 


69 


-04 


04 


50 


50 


00 


67 


53 


07 


4 


00 


80 


00 


08 


81 


00 


00 


80 


00 


-02 


88 


-05 


5 


00 


70 


00 


03 


69 


06 


00 


50 


50 


09 


65 


59 


6 


00 


75 


00 


10 


78 


-04 


00 


75 


00 


-11 


82 


-19 


7 


00 


00 


75 


06 


00 


76 


00 


00 


75 


05 


07 


83 


8 


00 


00 


65 


-01 


-02 


74 


50 


00 


50 


59 


07 


60 


9 


00 


00 


70 


-03 


04 


61 


00 


00 


70 


-08 


-02 


86 
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used to implement this hypothesis * 

A Case XV Solution 

In contrast to the examples used to illustrate Cases I and III* our data 
for the application of Case XV procedures were those gathered by Meyer and 
Bendig [1961], and subsequently reanalyzed by Harris [1963] and Corballis 
and Traub [1970]. As with the latter study, the number of components (factors, 
in the Corballis and Traub study) was determined to be two. Separate component 
analyses of the and matrices showed one latent root greater than one for 
R ^ and two, for R^. The canonical correlation analysis subsequently conducted 
yielded the following canonical correlations: *89, -74, .58, .45, .37. Thus, 

by finding maximally congruent linear composites, we found two components in 
each set that correlated highly enough to suggest that we were likely dealing 
with the same two constructs on each occasion. The R^, —2* anc * —12 Tna ^ r ^- ces 5 
as well as the other matrices of interest, are displayed in Table 4. 

The unrotated pattern matrices in Table 4 were obtained by the procedures 
given in (44) through (47)* A normal varimax transformation was applied to 
these patterns, with virtually no improvement in simple structure. Inspection 
of the plane spanned by the I-II vectors for each occasion revealed that no 
true simple structure resolution is possible with these data. It will be 
noted that although the two component cross-occasion correlations were altered 
in the transformation, their sum was unaltered. Inspection of the two unrotated 
(or rotated) pattern matrices reveals that a high degree of congruence was 
obtained, with the interpretation of the components likely identical on the 
two occasions. Finally, some of the difference between the present solution 
for these data and that given by Corballis and Traub [1970] is due to the 
fact that the latter authors derived components in terms of disattenuated 
correlations , 
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TABLE 4 

Correlations within and between Occasions, Correlations between Occasion 1 
and Occasion 2 Components, and Occasion 1 and Occasion 2 Pattern Matrices 
for a Case IV Solution Using the Meyer and Bendig Data (Decimal Points Omitted) 



Correlations of Variables 

Between Occasion 1 (Rows) 

Occasion 1 (R.^) Occasion 2 (R^) and Occasion 2 (Columns) 



100 








100 








81 


35 


42 


41 


24 


37 


100 






34 


100 






35 


65 


32 


14 


15 


42 


33 


100 




46 


18 


100 




49 


20 


75 


40 


17 


53 


14 


38 


100 


56 


06 


54 


100 


58 


“04 


46 


73 


15 


38 


10 


20 


24 100 


24 


15 


20 


16 100 


32 


11 


26 


19 


43 



Correlations between Occasion 1 and Occasion 2 Components 



Unrotated Components 
Occasion 2 Component 



Occasion 1_ 
Component 

I 

II 



I 


ii 


886 


000 


000 


743 



Rotated Components 
Occasion 2 Component 
I II 

859 056 

056 770 



Pattern Matrices 



Occasion 1 Occasion 2 



Unrotated 


Rotated 


Unrotated 


Rotated 


i ii 


i 


II 


I 


ii 


i 


II 


87 11 


73 


48 


91 


-02 


83 


38 


48 64 


15 


78 


38 


77 


00 


85 


77 04 


68 


37 


77 


-05 


72 


29 


69 -62 


89 


-26 


64 


-57 


82 


-23 


41 04 


35 


21 


31 


09 


24 


22 
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4 . Conclusions 

Procedures have been developed and in some cases illustrated for the 
factor analytic treatment of data matrices, involving the same subjects, 
obtained on two occasions. The specific techniques have differed in terms 
of whether or not the component scores and/or pattern matrices are hypothesised 
to be stable or unchanging over time. Good reasons can be advanced for the 
hypothesis of stable scores and patterns (our Case I) in some situations where 
only constructs that are constant relative not only to scores of the subjects 
measured, but also to the composition of these constructs in terms of linear 
combinations of the observed variables are of any theoretical interest. On 
the other hand, it is conceivable that situations may arise in which only one 
of these matrices may reasonably be expected to be constant- That matrix 
may be the component pattern (Case II) * with primary interest in changing 
scores of the subjects (relative to the respective group mean; changes in 
group elevation are not of concern) over time on these constructs whose 
composition over time is hypothesized not to change, or it may be the matrix 
of unchanging scores (Case III) * in which the interest lies in the changing 
composition (relative to the observed variables) of these unchanging constructs 
(relative to the subjects involved) . If the experimental situation suggests 
that both scores of the subjects and composition relative to the variables 
can be expected to change over time, our Cases IV and V may be appropriate. 
Case IV if we wish to maximize the congruence of the changing scores, and 
Case V if we wish as similar composition of the (changed) factors as possible. 
In each case, provisions have been made for a simple structure resolution. 

In all eases except Case IV, least-squares estimates have been provided for 
all hypothesized matrices. 

Although the procedures developed for Cases I, II, III, and V are least- 
squares, we have not attempted to provide techniques for evaluation of the 
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hypotheses embodied in the various cases. It appears conceivable that 
likelihood ratio procedures could be developed to estimate the goodness-of- 
fit of the reproduced data arrays—in terms of the estimated matrices— to 
the observed 2^ and matrices, 
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